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Title: SYSTEM FOR WIRELESS EXCHANGE OF DATA 

with Hand Held Devices 

This application claims priority to the following US provisional 
applications: 60/209,882 filed 6/06/2000, 60/229,973 filed 9/02/2000, 
60/242,963 filed 10/23/2000, and 60/245,517 filed 11/03/2000. 

TECHNICAL FIELD 

The invention relates to systems for wireless exchange of data, particularly with 
hand held devices. 

BACKGROUND OF THE INVENTION 
The background of this invention will be apparent from the attached disclosure. 

DISCLOSURE OF THE INVENTION 
This disclosure is attached. 



Kniest Wireless Devices 

The following wireless devices pertain to this application. The 
term "Kniest Wireless Devices" encompasses all these devices 
unless specifically stated otherwise. 

Handheld Web Based CD Players/ Recorders 

Handheld Web Based Cassette Player/ Recorders 

Handheld Web Based Digital Audi© Tape (DAT) Player/ Recorders 

Handheld Web Based Vide© Gamer 

(fandhefd Web Based Gamer a RC Controller 

Web Based Handheld Book/ Periodical "Reader" 

If eb Based Portable Music Synthesizers 

ttedlcal Image Reviewer 

ijedica! Ultrasound System 

Wearable Versions of the above Devices 

b 
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Context Diagram 




m VWWV WIRELESS LOGICAL MODEL WITH ENCODED DATA 

Web-Enabled Wireless Device Market Potential 

|ne Billion Mobile Web-Enabled Wireless Devices by 2003* 



€f ankee Group (Boston) 

m 
a 



Example Partners in Services and Products 



Company 


Service/ Technology 


Palm™ (3Com™) 


PalmOS™ a Palm™ Electronic Hardware Design 


BellSouth™ 


Wireless Data Network 


3Com™ 


Servers/ Data Center & Internet Connection 


Yahoo™ 


Content 


YellowPages.com™ 


Content 


WebAngel™ 


Browser Enhancement Software 
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Why Make Kniest Wireless Devices Palm™ Compatible? 



Fastest Time to Market 

Leverage off Other Applications 
o 

$pen Architecture 

m 

Host Advanced Wireless Solution for Handhetds 

II// Kniest Wireless Devices Have a Built in Global Positioning 
System 

a 

What Is GPS? 

Global Positioning Systems (GPS) are space-based radio positioning systems that provide 24 
hour three-dimensional position, velocity and time information to suitably equipped 
users anywhere on or near the surface of the Earth (and sometimes off the earth). 

For More Detailed Information 

http://www.trimble.com/gp s 

What does GPS do for Owners of Wireless Devices? 

The answer will become clear after the WebAmel section below 
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Combines CD Player/ Recorder, MPS Player, GPS and Palm™ PDA 




HANDHELD PDA 



Features 



Listen to any Music CD with Headphone Output 
AMI FM Radio 
Web Browser 
WebAngei User Agent 

Write any Downloaded Internet Content t© CD 

MP3 Format Music Files 
Other Compressed Audio Files 
Other Files 

a 

fbad WinX & Mac Compatible Files into Device from CD 
fflsplay any XML/ VML Format internet Content 
$M Palm™ Basic Applications Included 



Address Book 
To Do List 
Memo Fad 

Wireless Internet Messaging 

Color Touch Screen Display 

Battery or AC Adapter Powered 

Cradle Compatible with iRDA Port 

Upload CD Files t© Host PC/ Mac through IRDA Port 




Page 7 



Handheld Web Based Cassette Player/ Recorders 




Combines Cassette Player/ Recorder, MP3 Player, GPS and Palm 
PDA 



Listen to any Music Cassette with Headphone Output 
AM/ FM Radio 
Web Browser 
WebAngel User Agent 

Write any Downloaded Internet Content to Cassette 

MPS Format Music Files (Analog, Possibly Digital} 
Other Compressed Audio Files (Analog Possibly Distal) 
Other Files (if Digital) 

Read WinX & Mac Compatible Files into Device from Cassette 
Display arty XML/ VML Format Internet Content 



dolor Touch Screen Display 

Battery or AC Adapter Powered 

Cradle Compatible with iRDA Port 

Upload CD Files to Host PC/ Mac through iRDA Port 

Headphone Compatible Output 



AH Palm™ Basic Applications Included 




Handheld Web Based Digital Audio Tape Player/ Recorders 




Combines DAT Player/ Recorder, MP3 Player, GPS artel Palm™ PDA 



Listen to any Music DAT with Headphone Output 
AM/ FM Radio 
Web Browser 
WebAngel User Agent 

Writ© any Downloaded Internet Content to DAT 

MP3 Format Music Files (Analog, Possibly Dis tal ) 
Other Compressed Audio Files (Analog, Possibly Digital) 
Other Files fif Digital) 



Read WinX & Mac Compatible Files into Device from DAT 
Display any XML/ VML Format Internet Content 
AM Palm™ Basic Applications Included 

j§re Organitfng A\ 
Date Book 
Address Book 
tdDoList 
-* iPad 



ummuiu. 



Wireless Internet Messaging 

a 

dolor Touch Screen Display 

Battery or AC Adapter Powered 

Cradle Compatible with IRDA Port 

Upload CD Files to Host PC/ Mac through IRDA Port 

Headphone Compatible Output 



Portable Player/ Recorders (Boomboxes) 




Built in Stereo Amplifier and Speakers 

CD Player/ Recorder 

Cassette Player/ Recorder 

AMI m Radio 

Web Browser 

WebAngel User Agent 

Write any Downloaded Internet Content to CD 

MPS Format Music Files 
Other Compressed Audio Files 
Other Files 

u 

Rpad WinX & Mac Compatible Files into Device from CD 

Display any XML/ VML Format Internet Content 
P 

M Palm™ Basic Applications Included 

AeOrxaniyngAppUcations 

MteBook 

MdressBook 

& Do List 

Memo Pad 

Wireless Internet Messaging 

Color Touch Screen Display 

Battery or AC Adapter Powered 

Cradle Compatible with iRDA Port 

Upload CD Flies to Host PC/ Mac through IRDA Port 

Headphone Compatible Output 

Easy to Carry Handle 

Battery or AC Adapter Powered 

iRDA Port 
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Combines CD & Cassette Player/ Recorder, MP3 Player, GPS and 
Palm™ PDA 



o 
m 
m 

M 

m 

s 

o 
m 

o 
m 
a 
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Handheld Web Based Video Gamer Devices 




WehGamer Combines Nintendo Gameboy, MP3 Play 

Palm™ PDA 




HANDHELD PDA 



WebRCgamer Combines Nintendo Gameboy, RC Controller, MP3 
Player, GPS and Palm™ PDA 




HANDHELD PDA 
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Radio Remote Toys Controlled by WebRCgamer 



Cars. Boats, Airplanes. Airships with Built in Video Cam eras and Microphones 
Bluetooth and/ or Other Radio Frequency Protocol for Communication Bet 
WebRCmmer Controller 



Toy and 



■RFANTENW 



o 

m 

m 
u 

s 

a 

m 

Q 

m 
o 



I 



BAT 



:MEGWJ6M 

o 



'B/BEDDED 
VDEOGA1VERA 
fMTHSCASE, 
rTBPCNTED 
THROUGH 
V\*CSHELD) 



MCRCPHOSE 

TOPCKUPLJOGAL 

SOUND 




STEERNG 



WebRCgamer Controls Vehicle and Provides Vide© Image and Audio 
Playback of ActyalSy ls Being ss In the Vehicle! 



Laser Tag with Radio Remote Vehicles! 




rFAREDCR 

LASER 

DETECTER 



Players "Shoot" at Each Other! WebRCgamer Keeps Score! 

Alternative Technologies to "Sho ot" Each Other 

Radio Waves 
Ultrasound 

Vide© Camera and Microphone are Optional 
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Combines Palm PDA, MP3 Player, GPS and SoftReader 




HANDHELD PDA 

SOFTREADER 



t 
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With WebReader one could be Reading a "Free' 5 Book off the Web 

Advertising Embedded in Book 



r 



It was the right time for her to put aside 
her fear of his rej ection. She removed 
her waistcoat and revealed the tattoo. K 
really was a truely marvelous piece of 
work. He stepped back and took it all 
in, then moved forward and looked at it 
closely. She was quite nervous and 
breathing heavily. He sighed gently 
and reached for her. 



SUPER 



MOTELS 



Si 



If 

m 




Adjustable Font Size for Easy Reading 



One can Listen to a Book off the Web 

Keeping the Reader's Voice Output (Like a Book on Tape) 



r 



YOU ARE LISTENING TO: 

"COSMIC FIRE" byAuthorWordsmith 

READ BY: Ed Asner 




Controls 

Volume 

Playback Speed Without Affecting Speech Timbre 

Pause 

Stop 

Play 



Sharing a Book - Mom's Away on a Business Trip 



AT HOME - CHILD CAN HEAR MOM'S ] 
VOICE AS SHE READS THE BOOK. THE 
TEXT DISPLAY IS CONTROLLED BY 
MOM'S WEBREADER. » 




MOM'S READING A STORY 
TO HER CHILD AT HOME 




MOM CAN READ TO HER 
CHILD AS THEY SHARE 
THE SAME BOOK 
TOGETHER. 



THERE EVEN COULD BE 
A VIDEO LINK BETWEEN 
THEM 



Feature Summary 

Downloads Desired Reading Material off the Web 

Color Touch Screen Display 

Adujustable Playback Speed 

Speech Engine for Accurate Cadence and Timbre 

Text to Speech Engine for Text Only Input 

"Outdoor" Case 

Web Browser 

Web Angel™ User Agent 

headphone Compatible Output 

Hladphones 

lottery or AC Adapter Powered 

Cradle Compatible with SRDA Port 



Potential for at Least Two Product Offerings 

VfebReadeMOl 

M Features Listed Above 



WebReader 303 

All Features Listed Above 



"Sharine a Book" Capability 
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Synthesizers with Physical Modeling Technology 
What is Physical Modeling? 

Computer Simulates Actual Operation of Musical Instruments 

More Accurate S ound Synthesis of Practically Any Instrument Imaginable 
More Dynamic th an Sampled or Additive Synthesis 

For The Piano 

l&ital Waveeui des to Simulate Vibration Modes of the String 

I 

SMmlates Piano Hammer Strikine a String 
Mnulating the Sound Board and Piano Body 

qjftpturing the "Soul" of the Plan© 
5 

Akremelv Com plicated Instrument 

M 

Current Digital Pianos and Synthesizers a re Still Inadequate 

Processing Power Wow a Possibility for Incredible Piano Emulation 

High Speed Floating Point Digital Sienal Processors Possible 
Multiple Floating Points DSPs on a Sinsle Die 
RAM Costs Dramatically Reduced 
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Other Instruments (Patches) must be Available 

General MIDI Specification - Over a 128 Di fferent Instruments 
Kniest Instrumen ts Meet General MIDI and XG® Requirements 
License Techno logy for Outside Sources 

Kniest Synths can Change Instrument Materials for Different Sounds 



Steel Clarinet 
Wood Tuba 
Plastic Flute 

Mix and Match 1 

Strinet Mouthpiece - Tuba Body 
mimoet Mout hpiece - Clarinet Body 
Ifolin Bow on Piano (Instead of Hammer) 
hpno Hammer on Guitar 

E 

D 
fit 
CI 

m 
a 



Page 28 



Mobile Medical Assistant 




29 



Color Touch Screen Display 
"Outdoor" Case 

Browse Web for Medical Images 

Receive Images via E-mail 

Web Angel™ User Agent for Automatic Downloads 

Voice Recognition Software for Diagnosis Retention 

Headphone Compatible Output for Doppler Analysis 

Battery or AC Adapter Powered 

Cradle Compatible with iRDA Port 
o 

Bpllt in Microphone 

Etailt in Video Camera 

ftlini VHS Cassette Player/ Recorder 

F&B, NTSC or PAL Video Output 

C^neloop™ Feature* 

"Eoop" Storage on Internal Hard Drive 

vlebAngel Image Enhancement Algorithms 

WebAngei Image Measurements/ Calculations 

Voice Recognition and Text to Speech Output 

Partnership with Medical Database Provider 



^Sybase 




http://www.svbase.com/mobilehealthcare/ 



* Cineloov™ is a reentered trademark of ATL-Ultrasound 



temote Diagnosis Context Diagrams 



EXAM SHE- DOCTOR NOT AVAILABLE, SONOGRAPHER NEEDS DOCTOR'S 



I INPUT DURING EXAM 

I ULTRASCUNDM<\CHNE SEhOS VEEOM^S ANDALDO 

■ CX/ER NETWORK 

^DTE: aTW^JhD^CHfECOULDBE THE SERVER) 



ULTRASOUND 
MCHNEWITH 
ADDITIONAL 
VEEOWUT 



PORTABLE 
VDEO 
CAMERA 



BULTM 
SPEAKERS 
FCRAUDD 

OUTPUT 



KEYBOARD 
SCNOGRAPbER 





ULTRASOUND 
TRANSDUCER 



PATENT 



Context Diagrams - Continued 




Remote Oiagn 

In this scenario, the 
home while one of his/ 
doctor may direct the s < 
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osis Scenario 

doptor is guiding the exam remotely. The doctor in this case could be an OB-Gyn who is at 
her patients is in labor. Before deciding to go in to meet with the patient (in person), the 
onographer on where to "look" or place the probe on the patient's body. 



The WebMedica has 
the camera output to 
output is processed by 
option of controlling 
zooming. 



Ultrasound Imase and Video Camera Imase on WebMedica Display 



two 



images on the display, the ultrasound image generated by the ultrasound machine and 
the doctor see where the transducer is placed on the woman's body. The camera 
the ultrasound machine (or some other device) and sent to the server. The doctor has the 
video camera from WebMedica. Video camera control consists of focus, panning and 



help 



the 
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Doctor Provides Direction on Transducer Placement 



The doctor provides 
the voice input and 
orders through its 



direction to the sonographer by speaking into the WebMedica microphone, which records 
sends it back to the ultrasound machine. The ultrasound machine outputs the doctor's 
embedded audio/ speaker system. 



It is conceived that some 
image of the user back 
monitor. Essentially 
the ultrasound machini 



Doctor and Patient Conference Capabilities 



The doctor could also converse with the patient directly through the same medium. 



WebMedica devices could have a built in (or attachable) video camera to provide an 
to the ultrasound machine. The ultrasound machine would output the video image on its 

5 it would be a "video conference" with the handheld device being one terminal, and 
being the other! 



then. 



Remote Ultrasound Machine Control 

The doctor could also CONTROL the settings on the ultrasound machine through WebMedica. This would 
reduce the technical requirements of the sonographer. It is conceived that the sonographer could be anyone 
willing to hold the transducer on the patient with guidance from a qualified medical professional, 

A Limited to Ultrasound Applications 



This scenario is not limited to ultrasound applications. It is conceived that it could be used with any medical 
iiffiging modality. 



Ultrasound Transducer Blanket System 



Transducer "Blanket" Wrapped around (or Placed onj Patient 



Blanket has Multiple Transducer Assemblies Embedded In It 

Ultrasound Machin e uses one Transducer Assembly at a Tune (Multiplexed) 



Requires no Technical Expertise t© Capture Medical Images 

Good for Remote Diagnosis 



Blanket has Velcro Strips Outside 

Mm it in Place D^rim Exam 
Adjustable for Pi 



H 
€1 

■ s 

a 

m 
a 

yl 



Ultrasound Transducer Blanket System Context Diagram 



'EXAM SITE 



ultrasound 
mwewtth 

ADOmCNAL 
VDEONPUT 
AND POWER 7 
G3MTRCL 
SOURGEFCR 
LOCAL 
POSfTCNNG 
J3VSTEM 



ULTRASOUND TRANSDUCER BLANKET 





OPTIONAL 
LOCAL 
POSITION 
SYSTEM 
TRANSMITTERS 



Each Transducer Assembly may have a Global Positioning System 

Global Positioning System with Higher Resolution (Local System) 
Allows 3D Imaging! 




Transducer Assembly Diagram 



RAOORECEA/ERFCR 
aCBALPCSTTICNlNG 



WRNGTO 
MJLTPLEXER 




ISOLATION 
LAYER 



ANNULAR, LINEAR, MXTIPLAhE, PHASED, 
MVTRK FWSEDCROrHERULTRASOUND 
TR\NSDUCER£W SHAPE) 



SIDE VIEW OF TRANSDUCER ASSEMBLY 




MOTORIZED MULTIPLANE TRANSDUCER FACE 



Infrasound Blanket could be a Pad 

Multiple Transducers Embedded in Pad that is Placed at Strategic Points on the Body 




CABLETO 
ULTRASCUND MACHINE 
CRWRELESS 
ANTENNA 



HANDLE CR 
GRIP 



VELCRO 
STRP 




VELCRO 
STRPCN 
OTHER SDE 
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Blanket (or Pad) is Inflated Similarly to the Blood Pressure Sleeve to 
Ensure Good Coupling to the Body 



ARPUVP 




TOPATENT 

SIDE VIEW OF PAD OR BLANKET 



Infrasound Exam Procedure 

Arasound Coupling Gel is Applied to Entire Surface of Pad or Blanket 
PMd or Blanket is then Placed on Area of Interest 
I0eeded, Pad or Blanket is Strapped to Patient 

If Needed, Pad or Blanket is then Inflated to Ensure Proper Pressure Against Body 
Wtrasound Images Gathered and Processed 

CI 
yi 
O 

at 
o 



Ultrasound Machine may be Smaller ©r have Wireless Functionality 



•exam sue- ultrasound transducer blanket with handheld 
i wireless ultrasound machine 




SERVER 



CPTCNAL 
WRELESS 
VIDEO 
CAJVERA 
ON 

TABLE CR 
OTHER 
ELEVATED 
LOCATION 




WRELESS 
ULTRASOUND 
MVCHNE 




CFTCNAL BATTERY 
POAERED WRELESS 
L0CALPO3ITICN 
SYSTH^RANSMTTERS 

Qcr4} 



ULTRASOUND 
TRANSDUCER 
BLANKET 
(COJLDEVEN 
BE WRELESS!) 
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WebAngel Software 

Pre-Fetching Engine Gathers Information in Advance 
Uses Currently Viewed Content for Links to Other Web Sites 
Timer Driven Automatic Update 

Favorite Refresh Automatic Update 
Environmental Change Automatic Update 

Adaptable Feature Configuration 

A utomatic Push 



Changing Conditions Where WebAngel Automatically Forward 
Caches, Pushes or Modifies the Feature Configuration 



TMie of Day/ Week/ Year 


Time Since Last Content Update 


Weather 


Velocity 


Acceleration/ Deceleration 


Location 


Sftlcific User/ Owner 


Security 


Other Safety Constraints/ Danger 


\Sbration/ Impact/ Earthquakes 


Ambient Noise 


Humidity 


Pieh 


Depth 


Altitude 


Dgvice Temperature 


Ambient Temperature 


Client or Server Temperature 


^Nclear Radiation 


Other Conditions of Devices 


EM/RFI 


Wind Velocity 


Odor Detection 


Ambient Light 


Chemical Detection 


Construction 


Detour 


Service/ Fuel Availability 


Dust/ Pollution 


Plague/ Pestilence 


New Laws/ Judicial/ Government 


Scheduled Time/ Event 


Health of Person or People 


X-Rays 


Gamma Rays 


Ultrasound 


Traffic 


Rioting 


Wetness 


Spectral Content of Light 


Spectral Content of Sound 


Acts of God 


E-mail 


Network Messages 


New User Input 


Diagnostic Failure of a Device 


Interaet Web Site "Hits" 


Server Traffic on Network 


Client Traffic on Network 


Interaet Traffic 


Changes in Internet Content 
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Connection Arbitration 

WebAngel Automatically "Finds" Most Appropriate Wireless Protocol 

Example: Kniest Device Needs to Connect to Internet Kniest Device has two protocols for 
Wireless Connection, Bluetooth and BellSouth™. WebAneel would "Search" for 



Bluetooth Serve r First (which may be Freeh then Wireless Network Supplied bv say, 



BellSouth™ which may have Connection Charges 

Image Enhancements 

Edge Detection 
Line Interleave 
Grayscale Adjustment 
Chroma 

Nftiitiple Displays 

filn arid Zoom 

m 

Image Measurements 
[jjstance 

fea 
Volumes 

Velocity (Medical Application) 
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User Agent Software 

The following diagram illustrates how WebAngel fits into the host software: 




OTHER APPLICATIONS AND SERVICES 



DEVICE OS/ SERVICES 



WebAngel includes any of the above user agents or services/ formats. 
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User Agent Software on World Wide Web 




r i 



.....iD 

OOODQOD 



ORIGIN SERVER 



REQUEST (URL) 



WebAngel 
(USER AGENT) 



(RESPONSE (CONTENT) 




CONTENT 



WWW LOGICAL MODEL 



Wireless Device Context 




WWW WIRELESS LOGICAL MODEL (WITHOUT ENCODING OR DECODING DATA) 
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WebAngel Utilizing Encoded Data 




REQUEST (URL) 



r i 



DDOOBQO 

D0D0DOO 



ORIGIN SERVER 



RESPONSE (CONTENT) 




CONTENT 



WWW WIRELESS LOGICAL MODEL 



WebAngel Running Partially on Serverfs) (Encoded or Decoded) 



TIRELESS DEVICE 



WebAngel CLIENT 
(USER AGENT) 



J 



ANTENNA 



ANTENNA 




REQUEST (URL) 



M 



RESPONSE 



D00OQOO 



GATEWAY 



WebAngel 
SERVER 



REQUEST (URL) 



i i 



DDDDODD 



ORIGIN SERVER 



RESPONSE (CONTENT) 




WWW WIRELESS LOGICAL MODEL WITH WebAngel CLIENT AND SERVER 
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Data in this case is processed on another device (through a network, Intranet or over the web also): 



WIRELESS DEVICE 



ANTENNA 



L" 



1 



ANTENNA 



REQUEST (URL) 



WebAngel CLIENT 
(USER AGENT) 



RESPONSE 



.N 




DDDDDQO 



GATEWAY 



M 



WebAngel 
SERVER ON 
GATEWAY 



Hf 



0000000 



SEPARATE DEVICE 



REQUEST (URL) 



DODOOOO 



ORIGIN SERVER 




RESPONSE (CONTENT) 



WebAngel 
SERVER 




WWW WIRELESS LOGICAL MODEL WITH WebAngel SERVER ON MULTIPLE DEVICES 



Data processing in the above case means converting it to another format for transmission or interpreting the 
content and refining it for the client. 



Page 47 



WebAngel Software Detailed Description 

Cache Forward Engine Gathers Information in Advance 

Uses Currently Viewed Content for Links to Other Web Sites 

WebAngel pre-fetches or "forward caches" data. For example, the browser (which may or may not be part of 
WebAngel) reports back that there is interest in a specific area of information (which means it is being 
displayed or TTS to the user). WebAngel monitors how long the user "listens" or views a specific card (or area 
of the web page), which might have hyperlinks to other content. WebAngel then pre-fetches or forward caches 
the new information to be split into cards ready for viewing and/ or text to speech. 

Another example is as follows: The user loads a web page. As it is being downloaded (and displayed) the user 
reads (or listens to) the web page and its contents. If the user comes across something of interest, he/ she may 
"highlight" or "select" an area that he/ she is reading to give some feedback to the browser or WebAngel that 
thjf subject is of interest. WebAngel "looks" through the content for any links that are in that area and then 
fejfhes them (without output) while the user continues to read the current page. 

Af k>me time later, the user either selects a new area of interest in the current page/ card or "selects related 
pages" to download. If the user selects the hyperlink that is already downloaded, it is then ready for review. 
Sifection is done with a "mouse" like device, pointer, keyboard, clicker, buttons or speech. Selection also 
nfeans WebAngel keeps tract of how long the card is being displayed or read. If it is long enough, WebAngel 
nt&y search the current card for links to other content and start the Forward Cache process from there. 

\^bAngel is capable of being commanded to "store" up information requests, and download them as fast as 
pUsible for later viewing/ listening. For example, the user may want to download all songs written and 
pplformed by Elton John. WebAngel then is "started" at some address by the user and start searching ALL 
links at that site. It then downloads any "hits" and stores as many as possible on some medium like a hard disk, 
or CD/ ROM, etc. Any other sites that are linked to the original may have other links are searched 
automatically. 

Timer Driven Automatic Update 

WebAngel is configurable to fetch Internet content automatically based on the time of day or some other event 
has occurred. 
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Favorite Refresh Automatic Update 

WebAngel is configurable to automatically fetch Internet content "favorites" based on a timer or any of the 
other conditions listed below. 

Environmental Change Automatic Update 

If configured properly, environmental changes trigger WebAngel to automatically fetch Internet content 
"favorites" based on a timer event or any of the other conditions listed below. In this case, WebAngel is a pre- 
fetching engine (or user agent) that gathers local environmental parameters, sends them to an "analysis module" 
(part of WebAngel, which may "runs" on a different computer), which arranges for advance sending of only that 
data that meets the requirement of the environmental data. 

Adaptable Feature Configuration 

For example, suppose the device that is "running" WebAngel software is a computer in a truck, connected to the 
World Wide Web over a wireless connection. The computer has other inputs (e.g. Global Position or vehicle 
srftd (MPH) reading) to notify it when the truck is moving or not. If the truck is moving (not parked), 
\*j)bAngel may be configured to not display pictures or text that may distract the driver and create a safety 
isjfije. Instead, WebAngel may output by text to speech (TTS) the textual presentations of the information 
rejjiested. When parked, WebAngel may be able to show the pictures and text on the display. 

Agpther example may be, when the truck is moving, WebAngel is configured to not pre-fetch or "cache 
forward". 

Automatic Push 

QjBsorne event or time (see next section) WebAngel is capable of pushing content to a client (which under 
"ffirmal" conditions, may be a server or other computer). This may be in the form of e-mail or updated content. 
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Changing Conditions Where WebAngel Automatically Forward 
Caches, Pushes or Modifies the Feature Configuration 

The table below is a summary of "external" and "internal" conditions which can trigger WebAngel to forward 
cache, push or modify its feature configuration: 



Time of Day/ Week/ Year 


Time Since Last Content Update 


Weather 


Velocity 


Acceleration/ Deceleration 


Location 


Specific User/ Owner 


Security 


Other Safety Constraints/ Danger 


Vibration/ Impact/ Earthquakes 


Ambient Noise 


Humidity 


Pitch 


Depth 


Altitude 


Device Temperature 


Ambient Temperature 


Client or Server Temperature 


Nuclear Radiation 


Other Conditions of Devices 


EM/RFI 


Wind Velocity 


Odor Detection 


Ambient Light 


Chemical Detection 


Construction 


Detour 


Splice/ Fuel Availability 


Dust/ Pollution 


Plague/ Pestilence 


New Laws/ Judicial/ Government 


Scheduled Time/ Event 


Health of Person or People 


Xeititys 


Gamma Rays 


Ultrasound 


Traffic 


Rioting 


Wetness 


Spctral Content of Light 


Spectral Content of Sound 


Acts of God 


E^ihail 


Network Messages 


New User Input 


DSgnostic Failure of a Device 


Internet Web Site "Hits" 


Server Traffic on Network 


Client Traffic on Network 


Internet Traffic 





Image Enhancements 




WebAngel searches the image that is to be displayed for edges, where it then "outlines" the image in black or 
some other color appropriate to the image. There are many edge detection algorithms already developed for 
other applications. 
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Line Interleave 

WebAngel takes an image and interleave intermediate pixel data for a better quality image when zoomed up or 
magnified. For example, here is one algorithm for doing this: 

For this example, suppose the image (and display) is 100 by 100 pixels in size. It is desired to zoom up the 
image to double the image size or quadruple the number of pixels to display. So the new image is 200 by 200 
pixels, but only 1/4* the zoomed image is displayed at one time due to display size limitations. WebAngel 
"fills" every other new pixel with half the value from the previous pixel with half the value of the next pixel: 

Original Image 

PI P2 P3 P4 P5 P100 

P101 P102 P103 P104 P105 P200 

New Image: 

PI (Pl+P2)/2 P2 (P2+P3)/2 P3 (P3+P4)/2 P4 (P4+P5)/2 P5 ... P100 
(PA+-P101)/2 ((Pl+P2)/2)+((P101+P102)/2)/2 and so on. . . . 
Pfjl (P101+P102)/2 and so on P200 (which is now P300) 

Thire are many line interleave algorithms already being used. 

P|n and 2@©m 

Pan and Zoom of displayed images since display may be quite small. Panning the image is done with a 
trglkball type device to "move around" the image, or broken into pieces like in the storyboard below, or as done 
iifjhe TruckPC™ section later in this document 

Iipjhe following storyboards, WebAngel has broken Internet content into cards (or received them that way if in 
\^AP format). The operator gets to choose whether or not to view pictures. Only voice commands are shown 
here for simplicity sake. The "Presentation Manager" discussed below is part of WebAngel, or another 
application that actually displays the images: 




WEB ANGEL BROWSER DOWNLOADS 
PICTURE TO RAM 




WEB ANGEL COMPRESSES PICTURE TO 
FIT IN DISPLAY KEEPING PICTURE'S 
ASPECT RATIO - 




DISPLAY 
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DISPLAY 





WEB ANGEL BREAKS IMAGE UP INTO 
SMALLER CARDS FOR LARGER IMAGE 




PICTURE ASPECT 
RATIO 



CARD #8 TO BE 
DISPLAYED FIRST 
(YELLOW BORDER) 
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WebAngel allows the user to adjust the gamma curves to allow for better viewing a color image on a black and 
white display. 

Chroma 

If the client device has a color display, WebAngel takes a black and white image and assign a gradually 
darkening color (e.g. blue) instead of black for better visibility. Ultrasound medical devices use this feature to 
allow detection of subtle gradations of tissue in medical images. The gamma curve adjustment feature is also 
incorporated (as stated above) in the "Grayscale Adjustment" section. 



Multiple Displays 

wibAngel is capable of output with one display format, while converting the data for a different display. For 
eMmple, a computer in a truck may have a black and white primary display (for the driver and passenger) with 
ajblor RGB output for a remote display in the sleeper. 

image Measurements 

I^hay be desirable to actually "measure" an object on the display. WebAngel allows the user to place cursors 
opjan image and show the distance between them (based on the information provided for distance per pixel). 
Ale as, velocities (e.g. blood flow) and even volumes of objects on images are estimated using a variety of 
measurement schemes already developed for medical imaging devices (e.g. ultrasound machines). 
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Content to Cards for Text Output 

See the glossary (Appendix A) for the description of "cards" and "deck". Output Includes both Displayed Text 
and Speech (TTS) 

Standard Markup Languages / Scripts Parsed Into Cards 

SGML 

HTML 

XML 

VML 

CGI 



Java 
Others 




Tories 

Tift text to speech (TTS) output is configurable to identify when an end of a card has been read, audio file, 
pfeWe or hyperlink is available. Another way to notify the user "audibly" is to generate different tones for each 
tjjpe of "event". The tone is generated as an "overlay", or on top of the text (or just after it). 

Fpuse 

^bAngel allows the user to "pause" reading the text or listening to an audio file. 

Replay 

WebAngel goes back 10 seconds or so, and replay what was just listened to. 
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Deck Navigation 

As stated earlier, the web based content is divided up into cards by either WebAngel, another user agent, or 
done already in the WAP environment. WebAngel then allows the user to navigate the deck with the following 
features: 

Go-Back or Skip 

WebAngel allows the user to move to other cards backwards and forwards. 
Seek 

The user may have just the first line or phrase of each card read. WebAngel then automatically switches to the 
next card and repeats the process, until the user disables this feature to "stay" on the current card or stop the 
whole process. It also cab be set up to read (display) each card for a specified amount of time before switching 
to the next one. WebAngel identifies each new card with either a tone, text on the display or speech. If the seek 
feature finishes with the last card, it starts with the first one again, or prompts the user that the end has been 
reached with a tone, displayed text or speech. 

M^dKevWord 

WebAngel searches the deck for key word(s) or phrases that the user specifies. It may do this before 

dSj> laying/ reading any of the cards in the deck, or at any time during the "card reading/ displaying" process. 

0§ce found, the card is displayed/ read to the user as the new starting point. 
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Web Browsing with Kniest Wireless Devices 

General Description 

The content is in SGML, HTML, XML or VML format (so that it can be read on a standard VGA display also). 
The browser handles CGI, Java Scripts and VMLScript. 

Saving Web Pages 

The user can able to save at least eight web pages in flash memory. 

Browsing 

Tfife look and feel of the browser is outlined in the next few pages. 




Search Results 



Home 


Coupons 


Rewards 


Shop 


Business Center 


Consumer Center 



Your search resulted in 4 listings in the category of: 



Restaurants & Eating »Eatina Places»Pixza Restaurants 

DOMINOS PIZZA 

EDMONDS, EDMONDS, WA 98020 
Phone: (425) 672-3030 

DOMINOS PIZZA FIRDALE VILLAGE 




SUPER 

NATKjj^/IDE 

MOTELS 
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St it into this Small Spacel 




POWER 
SWITCH ON 
SIDE 
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User Taps Horizontal Scroll Bar to Mom Image Right 
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Another Tap Puts the Web Page in the Center Horizontally 




roll Bar All the Way Down, Horizont 



Search Results 



Home 



Coupons 



Rewards 



Your search resulted in 4 listings in the ca 

Restaurants & Eating »Eatina Places»Pizzs 

DOMINOS PIZZA 

EDMONDS, EDMONDS, WA 98020 
Phone: (425) 672-3030 



DOMINOS PIZZA FIRDALE VILLAGE 



http://www, yeliowpages.com/ 
searchform.asp?LEVEL1=&LEVEL2=&SearchBy 
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E-Mail Web Site Links 

The browser can to "go to" a site from a hyperlink contained in an e-mail message. 

Browser Configuration 

Favorite Web sites 

As stated earlier, the user can add/ remove at least eight favorite web sites. 

If there are already eight web sites saved, the user is prompted with the following on the display: "Maximum 
sites have been saved. Would you like to delete an older one?" If the user responds with the "No" button, the 
sequence is aborted and the computer waits for the user to continue browsing. 

Conversely, if the user responds presses the "Yes" soft key, the browser displays in menu format the first of the 
eight sites already saved and then allow the user to delete the unwanted one. If none are "over-written" then the 
bigwser starts with the first one again. The operator at any time can abort the sequence. 

Sound File Playback 

wjen a sound file is available, the web browser notifies the user that it is available. If the user selects playing i 
(ii this case with the stylus), the file is output through the audio system. 

While the sound file is being played, the display shows: "Sound File XXX". Buttons for stopping (and pause) 
the playback must be made available. 

Tsfrrt to Speech (TTS) 

S||ie devices have the text to speech feature. Buttons are provided to "play" the text on the display through th< 
afniio system. Buttons for stopping (and pause) the playback are also available. 

Help 

Anytime the help button is pressed the browser displays what functionality the soft and hard keys provide. 
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Wearable Wireless Devices 

Any ©f the Above Kniest Wireless Devices Wearable on Body! 
Portable "Movie Screens" for Larger Images (Even Full VGA!) 

Internal Video Projection Device for Screen or Watt 
Projection Video can be Turned off to Save Power 
Small Embedded Liquid Crystal Display Included for Control 
Other Models may have Buttons or "Mousepad" Device 

lap© or CD Drives are In Separate Enclosure Worn ©n Different Part ©f 

fcL.^ 

01 Protocol 

D 

m 

a 
m 

■Q 



Worn on Forearm Wireless Devio 

Strap Detachable, so Unit can sit on Table 



HAMDLETO 
PULLSCEEN 

our 



SCREENTHATGETS 
PULLEDaJTVWHENIVEEDED 
FCR LARGE DISPLAY 
FCRMM 

FK*AMM=VGECANBE 
PRQJECTEDCNAWALLCR 

BRGHTSURRACE! 



VDEOPROJECTCN 
SYSTEM 

(LICERCLEARCCX/ER) 




CCNTRCLS 

(TOLOH SCREEN, BUTTONS 
CR<XM3NATCN) 



DETACTHABLE STRAP SO 
DEVICE CAN BE WCRNCN 
FOREARM 



ELECTROMCS ENCL03LFE 
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Another Version: Display Driven from the Rear 

For Smaller Form Factor 

Video Reversible* for Both Modes of Operation (Wall or Screen) 




Another Version has Projector Mounted on Small Portable Stand that 
can be Projected on Desk or Wall. 
Wireless Link (Bluetooth) with Kniest Device 

Stand and Video Projector is S t ored in Kniest Device when not Needed or Carried Separately 



Strap Made of Gore-Tex® Type Material to Minimize Swe 

Bottom of Electronics Enclosure also Gore-Tex® Where it Meets Skin 



ELECTRONICS 
ENCLOSURE 




III I HIIIIIIIHIHIH II IIHI I HIIM I IIII 



GORE-TEX 
PAD WITH 
RIDGES FOR 
AIR FLOW 



SIDE VIEW OF ELECTRONICS ENCLOSURE 
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Appendix A: Glossary of Terms and Acronyms 



Term/ Acryonym 


Description — — — — 


API 


Application Programming Interface 


FTL 


Freightliner 


GPS 


Global Positioning System 


HTML 


Hyper Text Markup Language 


HTTP 


Hyper Text Transfer Protocol 


IP 


Internet Protocol 


MS 


Microsoft 




OEM 


Original Equipment Manufacturer 


PC 


Personal Computer — 


RAM 


Random Access Memory 


ROM 


Read Only Memory 


SAE 


Society of Automotive Engineers 


SRS 


Software Requirements Specifications 


TfiD 


To Be Defined 


T26P/IP 


Transmission Control Protocol/ Internet Protocol 


mc 


The Maintenance Council 


tm 


Text to Speech 


USB 


Universal Serial Bus 


WWW 


World Wide Web 
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Card 


A sinele markuo lansuase (e 2 WML HTML) unit of navigation and user interface. 

May contain information to present to the user, instructions for gathering user input, etc. 


Client 


A device (or application) that initiates a request for connection with a server. 


Client Server 

{"Vint mil it K*a tion 


Communication between a client and a server. Typically the server performs a task 
( such as ocneratinf? content^ on hehalf of the client Results of the task are usuallv sent 
back to the client f e e generated content ^ 


Content 


Synonym for data objects. 


Content Fjftf orfiitj? 


When used as a verb content encoding indicates the act of converting a data obiect from 
one format to another. Typically the resulting format requires less physical space than 
the original is easier to nrocess or store and/or is encrvoted When used as a noun 
content encoding specifies a particular format or encoding standard or process. 


Content Format 


Actual representation of content 


Content 

vjrviivi aim 


A service that generates or formats content. Typically content generators are on origin 

servers 

Owl v VI O* 


Deck 


A collection of markup language (e.g. WML, HTML) cards. A deck may also be an 
XML document. May contain WMLScript or JavaScript 


ftfvice 


A network entity that is capable of sending and receiving packets of information and has 

a iifii^iiip dpvifv* ftddri^c A df*vipe cavk af*t Hoth j* pliant smd s* cerver within si crivpn 
<X UlHv|uv VAvvlwC' ctCiUlCDa, r\ UvVlWC villi avt <lo UUIH <X VHvilt allU » SdYd WlUllll d ^lvwll 

context or across multiple contexts. For example, a device may service a number of 
clients (as a server) while being a client to another server. 


Distance root 
mean square 

|8rms) 


The root-mean-square value of the distances from the true location point of the position 
fixes in a collection of measurements. As typically used in GPS positioning, 2 drms is 
the radius of a circle that contains at least 95 percent of all possible fixes that can be 

ohtpin^vl with a svstem at jmv one Wlace 
xjij icwi-ivvt wiixi <x oy at&ni ai dixy v/iiv- piu-vv. 




The U.S. Department of Defense Global Positioning System; A constellation of 24 

satellites orhitini? the earth at a verv hish altitude OPS satellites transmit signals that 

ijniviiiivo vi i/iuxig uiv wen ui cm. ** rvx y xxx^xx uiuiuuv. vjx u oaiwiiiivo wicwxoxxxxi, jx^xhixo ixxcit- 

allow one to determine, with great accuracy, the locations of GPS receivers. The 
receivers can be fixed on the Rarth in m ovine vehicles aircraft or in low-Rarth orbitins; 
satellites. GPS is used in air, land and sea navigation, mapping, surveying and other 
applications where precise positioning is necessary. 


GPSICD-200 


The GPS Interface Control Document is a government document that contains the full 
technical description of the interface between the satellites and the user. 


Javascript 


A si/2 T/y/^tsi et O'tt/roivi 1 <a fi mi c» rr£* triat tnaxj r%£* iica/i ff\ c*/i/i ftxmatYMf* r\£*rici\/i/vn'r ft\ 1-4' t A AT 
r\ UfZ JCIOIO blctilUalU icUlguagC Uidl IHay UC UfcCU IU dUU UyilcUUlV OCHaVlUUI IU XT 1 lVJLU 

documents. JavaScript is one of the originating technologies of ECMAScript. 


XtXUUvIU. 


A fTio/^iilfttor/Hf^TttO/iiiliatrvr \X/hf*n iwA PAtYitvntf^fc ^AttiTnntiif^fttf* a\/p»t t*^1f*T%hotiP fc lin^c cinH 

rV lllVjiuU-lCllsJl/ CtCIIIL?UUx«l»Jl , VVxlwII IWu U'wlijl^/litdo v\JlliliIUxJl\/Ctl.C UVCI IClvjpxiVllC Hllva «xlVl 

similar mf^Hifi ^Hoital sicttisiIg must hp ^onvprtprl to flnalncr rlnrinc trsmsmission thf*n 
hack a^ain to digital at the destination Mjodems are alwavs used in nairs one at each 

end. They are rated according to the speed, typically in "bits per second," at which the 
information can pass through the transmission medium. 


Oriffin Server 


The server on which a given resource resides or is to be created Often referred to as a 
web server or HTTP server. 


Pre-Fetch 


In this case, WebAngel software "looks and downloads" Internet content automatically. 


Push 


Unsolicited "sending of information" to a client device. 


Resource 


A network data object or service that may be identified by a URL. Resources may be 
available in multiple representations (e.g., multiple languages, data formats, size and 
resolutions) or vary in other ways. 



Page 73 



Server 


A device (or application) that passively waits for connection requests from one or more 
clients. A server may accept or reject a connection request from a client. 


SGML 


The Standardised Generalised Markup Language (defined m [IS08879]) is a general 
purpose language for domain specific mark up languages. 


Standard 
Positioning 
Service (SPS) 


The normal civilian positioning accuracy obtained by using the single frequency C/A 
code. Under selective availability conditions, guaranteed to be no worse than -10 meters 
95 percent of the time (2 drms). 


User 


A user is a person who interacts with a user agent to view, hear or otherwise use a 
resource. 


User Agent 


A user agent is any software or device that interprets content (e.g., WML, XML, 
ovjiviUy ri i ivLL ). i nis may lnciuae xexuiai orowsers, voice orowsers, searcn engines, 

wlv. 


WebAngel 


WebAngel is the trademark for a kind of computer software package that runs "on top" 
of a World Wide Web browser ( a user a&erif^ Tt controls the user fluent software or it 

incorporates a browser. It is to be considered just part of the user agent, or all of it 
depending on the application. 


WfebAngel Client 


Software subset of WebAngel software that runs on the client 


WbbAngel Server 


Software subset of WebAngel software that runs on a server. NOT DONE FOR THIS 
APPLICATION 



